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(57) An image-related device (e.g. printer 43 or dis- 
play 42), having a memory (63, 81-83) whose use is to 
be limited, receives input-image data (e.g. by IR link [64] 
from a camera [41]). The data represent a series of im- 
age strips (21, 22-25). Minimum processing units 
(MRUs) are set up, related to data and output-image for-, 
mats and to method. After data acquisition for a first 
MRU type, those data are scaled down (133) in at least 
one direction, the scaled-down data accumulated (134) 
for a second MRU type; and the accumulation com- 
pressed/formatted (141). By iteration (135, 144) the 
whole image is refomnatted without injecting artifacts. 
Each MRU type is best a small fraction of the image; the 
character of each MRU is subject to function. Thus each 
MRU may be a partial input-image strip, with enough da- 
ta for downsampling or compression respectively; or a 
full Input-image strip with at least a full pixel column or 
row. Preferably downsampling is to a pixel dimension of 
the received MRU as it is to be used, Le. an output strip. 
Formatting is best JREG or TIFF or the like; analogous 
analysis can be substituted using e.g. a discrete cosine 
transform or other analysis of suitable pixel blocks for 
discrimination of fine color detail. If incoming data are 
compressed, or not in YOG, decompression (123) or 
conversion (131) can be done before downsampling 
(133). Input/output data sizes can be tested (132) to 
evaluate using another method (128. 126) for the novel 
iterative one. Control is by ASIC (52). finmware (72) or 
a printer/display driver (86). 
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Description 

[0001 ] This invention relates generally to image-relat- 
ed devices, for example economical devices for con- 
sumer use, such as incremental printers, small LCD or 
other video displays that are processor operated, scan- 
ners, digital cameras and the like - especially such de- 
vices whose memory is to be limited - and apparatus 
and methods that facilitate transfer of data to and from 
such devices. In this document the phrase "memory is 
to be limited" encompasses memory that in fact is limit- 
ed. 

[0002] A closely related document is another, co- 
owned U.S. utility-patent application filed in the United 
States Patent and Trademark Office substantially con- 
temporaneously with this document. It is in the names 
of Norton et al., identified as Hewlett Packard Company 
docket number PD-1 090536-1 , entitled "Task-Parti- 
tioned Hybrid Codec" - and subsequently given serial 
08/ , and issued as U.S. Patent 5, 



[0003] (a) The problems of data transmission into a 
memory that is to be limited - The present invention 
arose through attempts to store and print JPEG-com- 
pressed images received by an incremental printer, from 
a digital camera, by means of an infrared link. For best 
economy, the printer is provided with only a small mem- 
ory. 

[0004] Because the images are received only once, 
they should be stored in memory - but these images, as 
sent by the camera, may require more memory than is 
available to store them. Some common approaches to 
dealing with this situation have their own drawbacks, as 
will be explained below. 

[0005] The difficulties encountered in this context, 
however, are common to other situations involving a 
memory that is to be limited. For example, the same dig- 
ital camera may have a small LCD display for viewing 
thumbnail images of individual pictures while they are 
still in the camera. 

[0006] The amount of data that represents af ull image 
seen on that display is far smaller than what is available 
for the same image, on the main memory chip for the 
same camera. Data for the thumbnail display are there- 
fore advantageously transmitted within the camera into 
a highly compressed form for storage and presentation. 
[0007] Thus the more-general problem is that an im- 
age data set from a source may be considerably larger 
than needed, or than it is possible to use, in presenta- 
tion. The result may be wasted transmission time and 
storage space, if the system uses the whole data set. 
Another manifestation of the problem, aside from unwill- 
ingness to waste storage space, is that there simply may 
not be enough storage available. 

[0008] These various difficulties are not limited to pho- 
tographic images. Rather they extend as well to data 
sets representing image-like information such as topo- 
logical-style terrain maps - provided only that the data. 



lil<e photographic information, can be used even if ren- 
dered in an approximate way. 

[0009] (b) Known procedure when Intermediate mem- 
ory is adequate - Perhaps the most interesting side of 
5 this general problem is the inadequacy of one well- 
known methodology that is commonly employed in 
these situations. 

[0010] That technique is to decompress each image, 
as it comes in, and then recompress making the data 

10 set smaller for the same image - thereby guaranteeing 
that all the images fit into the allotted memory. This is a 
particularly simple and appealing approach because 
JPEG compression and decompression algorithms 
have to be available in the system anyway, and are ca- 

15 pable of extremely high compression ratios with only 
minimal loss of perceived image quality. 
[0011] A major disadvantage, however, is that pass- 
ing the image through plural generations of decompres- 
sion and/or compression (e.g., of JPEG compression) - 

20 at least for closely similar image sizes - introduces arti- 
facts into the images as eventually presented (dis- 
played, printed^ etc.). These artifacts are often very 
readily perceptible as evident defects in the presented 
image. 

25 [0012] Such artifacts sometimes arise through round- 
ing errors, or because data blocks employed in com- 
pression at the different stages do not match one anoth- 
er, or through interactions between these phenomena - 
or in still other ways. Hence it is very desirable to avoid 
30 such serial decompression and recompression - at least 
without some compensating action, 
[0013] Another side of the same problem is that not 
all images to be transferred may in fact Involve such size 
relationships. In systems or methods which must accept 
35 a variety of input image data sets - or which may be 
called upon to present images at a variety of output res- 
olutions - it becomes necessary to provide a robust so- 
lution despite such varying demands. 
[0014] (c) Conclusion - Thus problems of data han- 
40 dling have continued to impede achievement of uniform- 
ly excellent but rapid transmission and presentation of 
images and image-like data in small, economical sys- 
tems. Thus important aspects of the technology used in 
the field of the invention remain amenable to useful re- 
45 finement. 

[0015] The present invention seeks to provide im- 
proved image compression. 

[0016] According to an aspect of the present inven- 
tion, there is provided a method of receiving input image 
50 data as specified in claim 1 . 

[0017] According to another aspect of the present in- 
vention, there is provided an image-related device as 
specified in claim 10. 

[0018] In the preferred embodiments, several aspects 
55 or facets can be used independently, although they are 
preferably employed together to optimize their benefits. 
[0019] In preferred embodiments of a first facet or as- 
pect, there is provided a method for receiving input-im- 
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age data in an innage-related device having a memory 
whose use is to be limited. The method includes the step 
of receiving a data stream containing the data and sub- 
stantially corresponding to a series of successive strips 
of an image. 

[0020] Another preferred step of the method is estab- 
lishing minimum units of processing that are related to 
a format of the data stream, and also to an output-image 
format. In addition each minimum processing unit 
(MPU) is related to the steps recited below. 
[0021] Three other steps may be performed during 
the receiving step, and after receiving data for at least 
a first of the minimum units of processing. These other 
steps include: 

downsampling, In at least one direction, the data for 
the first received minimum unit of processing, 
then accumulating the downsampled data for at 
least a second of the minimum units of processing, 
and 

then compressing the accumulated downsampled 
data. 

[0022] The foregoing may constitute a description or 
definition of a first facet in its broadest or most general 
form. 

[0023] Using Intermediate memory - If an intermedi- 
ate memory (for instance, memory In an associated gen- 
eral-purpose computer) is available at least temporarily 
- in particular during data transmission - then the mini- 
mum units of processing can be made equal to the entire 
image. In this case the process is performed on the 
whole Image in one chunk. 

[0024] Even in this case the downsampling introduces 
a great benefit, as the downsampled Image can be rec- 
ompressed without significant concern for introduction 
of artifacts. The data can then be stored in a very small 
memory such as typically and economically provided In 
a display device such as a printer, a camera thumbnail 
display, etc. 

[0025] Direct transfer - If no such large intermediate 
memory is available, however - for instance, if a digital 
camera Is !R-linked directly to a printer as outlined ear- 
lier - then the procedure is modified to use less memory 
by decompressing and downsampling only part of the 
Image at a time. In this case, each ofthe "minimum units 
of processing" is made, e.g., a small fraction of the over- 
all image. 

[0026] In particular, because each minimum process- 
ing unit is a small fraction of the image, the memory re- 
quired to hold the data accumulations before they can 
be downsampled or compressed - respectively - can be 
made quite small. (Of course the memory required to 
hold the entire compressed data set is inherently small, 
as already noted.) 

[0027] Hence the total memory needed Is much small- 
er than what would be required if data for the entire im- 
age were received before beginning compression. It will 



be understood that the steps of the method can be iter- 
ated many times to eventually acquire the entire com- 
pressed image - and yet, because of the piecemeal op- 
eration, a memory of very modest size can comfortably 
5 accommodate the overall process for a rather large in- 
put data set. 

[0028] Those skilled in the art will thus appreciate that 
the effectiveness of this strategy relies upon informed 
and judicious choice and usage of the minimum 
10 processing units. Optimization of such tactics in turn de- 
pends, as wilt be seen, on careful analysis of the struc- 
tural characteristics underlying the compression proc- 
ess. 

[0029] Although the receiving-and-downsampling of 

15 the first processing unit is iterated to accumulate the 
second processing unit - and the accumulation-and- 
compression of the second processing unit is then iter- 
ated to accumulate the entire output Image - yet these 
forms of iteration are benign. Because particular pieces 

^0 of an image are not passed through multiple generations 
of processing, but only layered systematically into the 
output image, these iterations do not create the kinds of 
image artifacts or defects noted in the preceding section 
of this document. 

25 [0030] This embodiment is preferably practiced in 
conjunction with certain other features or characteristics 
that further enhance enjoyment of overall benefits - such 
as, for Instance, configuration ofthe minimum process- 
ing units as mentioned just above. 

30 [0031] For example, in the direct-transfer case it is 
preferable to make the units of processing a small frac- 
tion of the image, for the reasons already mentioned. 
Such a fraction for instance may be one-quarter or. say, 
one-fortieth (1/40). For image-related devices which 

35 store or present the Image in quite small format, the frac- 
tion may be much smaller - for example less than one- 
thousandth. 

[0032] Also it is preferred that the first unit of process- 
ing be at least a partial strip of the input image, that "at 

40 least partial strip" containing enough information to en- 
able the downsampling. In this case, a still further pref- 
erence is that the first unit of processing be a full strip 
of the input image, the full strip including at least one full 
pixel column or row. 

45 [0033] It Is also prefen-ed that the second unit of 
processing be at least a partial strip of an output image 
to be presented by the image-related device, this sec- 
ond at-least-partial-strip - analogously to the first partial 
strip mentioned - containing enough information to en- 

50 able the compressing. In this case, a further preference 
Is that the second unit of processing be a full strip of the 
output Image, this full strip including at least one full pixel 
column or row. 

[0034] Another basic preference is that the downsam- 
55 piing step Include downsampling the data to a pixel di- 
mension of the received strip as it is to be used in the 
image-related device. Yet another Is that the compress- 
ing step include JPEG compression, or include data for- 
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matting which is of a type associated with TIFF files. 
[0035] Thus, as those skilled in this field will now rec- 
ognize, the techniques of this invention are very power- 
ful for they enable extraordinarily memory-efficient han- 
dling of these very useful and ubiquitous file types. The 
two types are discussed together here only for the sake 
of convenience, and it will be understood that embodi- 
ments of the invention related to these file types are 
highly distinct from one another in both concept and im- 
plementation. 

[0036] Analogously, another preference is that the ac- 
cumulating step include accumulating enough of the 
downsampled data to enable JPEG compression of a 
strip of the image as it is to be used in the image-related 
device - or TIFF formatting of a portion of the image as 
it is to be used in the image-related device. 
[0037] For some file formats, preferably the accumu- 
lating step comprises accumulating at least enough of 
the downsampled data lo represent at least one dis- 
crete-cosine-transfonnable block of the image as it is to 
be used in the image-related device, for application of 
a discrete cosine transfomi thereto. More specifically 
such a block is advantageously an eight-by-eight-pixel 
block of that output imago - and still more advanta- 
geously the invention accumulates a strip of such eight- 
by-eight-pixel output-image blocks. 
[0038} Earlier in this document It is pointed out that 
iterations of decompression and compression can cor- 
rupt files in the sense of introducing visible and objec- 
tionable discontinuities or color error into images. Al- 
though this remains true for images that are later, or ear- 
lier, processed, nevertheless it is possible to use the 
teachings herein for data that have been, for example, 
previously compressed. 

[0039] Such usage is desirable if that is the only way 
to gain access to the previously compressed data. Ac- 
cordingly another preference with respect to the first fac- 
et or aspect is that the receiving step include receiving 
compressed data; and that the method further include 
the step of - before the downsampling step - decom- 
pressing the received data. 

[0040] A more general preference is helpful particu- 
larly for file fomnats in which large compression factors 
are obtain through discrimination of fine chromatic detail 
- to which the eye is insensitive. This preference is to 
include an additional step, before the downsampling 
step: if the data are not already expressed in a lumi- 
nance/chrominance color space, the data are trans- 
formed into such a color space. This step facilitates dis- 
criminatory treatment of chromatic details of different 
fineness (spatial frequency). 

[0041] Another general preference is the further step 
of then storing the compressed data for use in the im- 
age-related device. Yet another general preference is 
that the downsampling step be performed in only the 
horizontal direction or only the vertical direction; this 
case corresponds particularly to a related preference - 
that the first unit of processing be substantially a single 



horizontal or vertical pixel row. 

[0042] In preferred embodiments of a second facet, 
there is provided a method for receiving Input-image da- 
ta in an image-related device having a memory whose 

5 use Is to be limited. The method may include the step 
of receiving a data stream containing the data and cor- 
responding to a series of successive strips of the image. 
[0043] Another preferred step determines whether 
the data stream represents an overall pixel dimension 

10 greater than desired in the image as it is to be used in 
the image-related device. If so (that is, if the determining 
step in fact determines that the data stream does rep- 
resent such a greater overall pixel dimension), then the 
method preferably includes these additional steps dur- 

?5 ing the receiving step, after receiving data for at least a 
partial strip of the input Image: 

downsampling the received data, 
accumulating the downsampled data for at least 
20 one partial strip of the input image, 

compressing the accumulated data for at least a 
partial strip of the image as it is to be used in the 
image-related device, and 

storing the compressed data for use in the image- 
rs related device. 

[0044] The foregoing may constitute a description or 
definition of the second facet in its broadest or most gen- 
eral form. Even in this general form, however, it can be 
30 seen that this facet too significantly mitigates the diffi- 
culties left unresolved in the art. 

[0045] In particular, this embodiment differs from the 
previously discussed embodiment with respect to the 
contingent nature of this second facet. The procedure 

35 is followed if it is established that the data stream rep- 
resents more detail - Le^, more overall resolution - than 
the image-related device can or will use. 
[0046] Accordingly this method preferably enables an 
image-related device to achieve all the benefits dis- 

40 cussed above for the first aspect of the invention. In ad- 
dition, however, it does so without impairing the ability 
of the device to deal with data that are inconsistent with 
the operating assumptions underlying that first aspect 
of the invention. 

45 [0047] Again, although this second embodiment in its 
broad form thus represents a significant advance in the 
art, it is preferably practiced in conjunction with certain 
other features or characteristics that further enhance 
enjoyment of overall benefits. 

so [0048] For example, it is preferred - if the data stream 
does not represent an overall pixel dimension greater 
than desired in the image as it is to be used in the image- 
related device - to then use a different procedure for 
storing information from the data stream. (Merely by way 

55 of example, one straightforward approach may be to ac- 
quire the entire image without compression.) 
[0049] In preferred embodiments of a third facet, there 
Is provided an image-related device having a memory 
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whose use is to be limited. The device includes a data 
receiver for receiving a data stream containing image 
data and corresponding to a series of successive strips 
of an image. 

[0050] The device preferably also includes at least 
parts of a programmed processor and memory for: 

downsampling the received data for at least part of 
a strip in the series as received, 
accumulating the downsampled data for at least 
part of one received strip, 

compressing the accumulated data for at least part 
of an image strip to be presented, and 
storing the compressed data for presentation. 

Finally the device includes elements for presenting the 
Image based upon the stored compressed data. 
[0051] The foregoing may represent a description or 
definition of the third facet in its broadest or most general 
form. Even as couched in these broad terms, however, 
it can be seen that this embodiment importantly advanc- 
es the art. 

[0052] In particular this embodiment provides a sys- 
tem for obtaining the benefits of the methods discussed 
earlier - and also further develops those benefits by in- 
cluding mechanisms for actually forming the advanta- 
geous^y transferred image in some presentation. The 
terms "presenting" and "presentation" as used here re- 
fer to some physical manifestation on paper, or on a dis- 
play medium (for instance a screen), or otherwise actu- 
ally embodied as for example through three-dimension- 
allithography. 

[0053] Although this embodiment significantly ad- 
vances the art, nevertheless to optimize enjoyment of 
Its benefits it is preferably practiced in conjunction with 
certain additional features or characteristics. In particu- 
lar, preferably at least part of the programmed processor 
and memory includes: 

an application-specific integrated circuit, or 
firmware and a memory operating in the image-re- 
lated device; or 

a printer driver or display driver, operating in an as- 
sociated general-purpose computer or raster image 
processor 

[0054] Another preference is that the data receiver in- 
clude an infrared data link for accepting the data stream 
from a digital camera. Still another preference is that da- 
ta receiver include some means for receiving com- 
pressed data; and that the invention further include 
some means for decompressing the received data be- 
fore downsampling. 

[0055] Another preference is that the presenting ele- 
ments be for presenting the received strip with a partic- 
ular pixel dimension: and that the programmed proces- 
sor include some means for downsampling the received 
data to that particular pixel dimension. Yet a further pref- 



erence is that the programmed processor include some 
means for formatting the data in a format associated 
with TIFF files., or for compressing the accumulated data 
by JPEG compression. (Again these two cases are to 

5 be regarded as distinctly different from one another.) 
[0056] As mentioned in conjunction with the first em- 
bodiment described above, the structuring of the "mini- 
mum processing units" can be particulariy advanta- 
geous in practical situations. The same is true for other 

fo features under consideration now. 

[0057] Accordingly afurther preference is that the pro- 
grammed processor and memory include some means 
for accumulating at least enough of the downsampled 
data to satisfy some rational criterion related to opera- 

75 tion. Some usable criteria include the following: 

sufficient data to enable JPEG compression of a 
strip of the Image as It Is to be printed, 
enough data to represent al least one discrete-co- 
20 sine-transformable block of the image as it is to be 
presented, for application of a discrete cosine 
transform thereto, 

enough of the downsampled data to represent at 
least one eight-by-eight-pixei block of the image as 
25 it is to be presented, for application of a discrete co- 
sine transform thereto, and 

enough of the downsampled data to represent a 
strip of eight-by-eight-pixel blocks of the image as 
it is to be presented, for application of a discrete co- 
30 sine transform thereto. 

It will be understood that within the scope of the inven- 
tion a skilled practitioner in this field may advantageous- 
ly employ one or more of these enumerated criteria. 

25 [0058] Preferences previously enunciated are appli- 
cable here as well (and conversely those mentioned 
here may be applied in regard to those eariier-discussed 
facets). Thus for instance there is preferably Included 
some means fortransfonning the data into a luminance/ 

40 chrominance color space before downsampling, if the 
data are not already expressed in a luminance/chromi- 
nance color space. 

[0059] Further preferably the device is either a printer 
or a display unit; and the forming elements are respec- 
ts ti vely either elements for marking the image onto a hard- 
copy printing medium or active video pixels. Other pres- 
entation provisions mentioned above are useful, but 
these two are deemed the most highly preferable by vir- 
tue of their very broad range of applications. 
50 [0060] Another preference applicable to the several 
embodiments is that the downsampling and accumula- 
tion steps be iterated, preparatory to the compressing 
step, so that a suitable amount of data is then made 
available at once for accumulation. Analogously the 
55 compressing step is advantageously iterated so that an 
entire amount of data needed to represent an image - 
or at least some meaningful or sensible portion of an 
image - can be presented at once. For instance, in the 
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case of images coded for progressive presentation, the 
foregoing terminologies are to be understood as con- 
strued broadly to encompass the successive partial Im- 
age data that enable presentation of progressively bet- 
ter-resolved partial images successively. 5 
[0061 ] An embodiment of the present invention Is de- 
scribed below, by way of example only, with reference 
to the accompanying drawings, in which: 

Fig. 1 is a graphical representation showing how da- io 
ta are compressed - particularly if an entire image 
can be manipulated at once, as for instance in an 
intermediate memory; 

Fig. 2 is a like representation showing how the same 
task can be accomplished if no such intermediate ?5 
memory is available, and a piecemeal-processing 
form Is employed; 

Fig. 3 is a pair of comparative tabulations, Tables A 
and B for 1 2 and 8 pixel/mm (300 and 200 pixel per 
inch) final output respectively, illustrating the impor- 20 
tance of contingent processing in some embodi- 
ments; 

Fig. 4 Is a block-diagrammatic representation of a 
preferred system; and 

Fig. 6 is a flow diagram of a preferred method. 25 
1. INPUT DATA 

[0062] The apparatus and methods of preferred em- 
bodiments described below may begin their work with a . 30 
data set. or data stream, that is either compressed data 
11 (Fig, 1) or already-decompressed data 12-14. The 
compression regime suggested In the illustration is 
JPEG, but as mentioned earlier the invention is applica- 
ble to other data formats. 35 
[0063] Most Image-like data files have header blocks 
containing various details such as the type of fonnatting 
employed in preparing the file, and various parameters 
used in the preparation, etc. - to enable proper extrac- 
tion of some approximation to the original infonnation. 
If the data are being transmitted within an essentially 
closed system, however, most or all such information is 
typically omitted from the file because the receiving sys- 
tem and method can be designed on the basis of that 
information. 45 
[0064] One way to manage the uncompressed image 
data is in the form of three color-space dimensions - 
namely the luminance Y (1 2) and two chromatic param- 
eters Cb (13) and Cr (14). Loosely speaking, the latter 
two parameters convey ail the information required to so 
establish the hue and saturation. 
[0065] The utility of this color space is well-known 
from its broad application in broadcast video. It is par- 
ticularly noteworthy that the human eye is insensitive to 
moderate-size errors or relatively coarse resolution in 55 
the chromatic variables Cb, Cr - provided that the lumi- 
nance Y is acceptable. 

[0066] This fact is at the root of the compression strat- 



egy embodied in JPEG and some other file-formatting 
schemes, for it enables a user to select a "quality" level, 
over an extremely broad range of such levels, which dis- 
criminates against relatively fine detail in the chromatic 
information. A user's selected "quality" value defines, 
predominantly, what coarseness of chromatic detail - 
and what amount of hue error - will be tolerated in the 
interest of compactness for storage and transmission 
purposes. 

[0067] Because of the visual insensitivity noted 
above, even a rather low quality selection is ordinarily 
perceived as acceptable. This is true even though the 
associated data compression can be quite extreme - 
such as, for instance, one-half order of magnitude to 
more than two orders of magnitude. A smaller proportion 
of the achieved compression is taken in the luminance 
data than in the chromatic. 

[0068] At this writing, good useful introductory infor- 
mation about these concepts - and JPEG compression 
generally - is conveniently available on the WoridWide 
Web starting at: http:/Awww.faqs.org/faqs/jpeg-faq/partl/ 
preamble.html and http://www.faqs.org/faqs/compres- 
sion-faq/partl/, both primarily due to Mr. Thomas G. 
Lane. His helpful personal assistance to the writer of this 
patent document is gratefully acknowledged. Included 
in those materials is considerable further bibliographic 
guidance. 

[0069] The luminance-chrominance approach, how- 
ever, is not at all a required way of using the present 
invention. Very much to the contrary, the present inven- 
tors actually make very good use of the invention in a 
system that handles the data wholly in RGB (additive 
red, green and blue lights) color space. 
[0070] That system need not be used for JPEG files, 
and is very practical in various other situations. Hence 
thie notations In Fig. 1 are only exemplary, and for pur- 
poses of this description the image data may be repre- 
sented in essentially any three variables 12-14 of ma- 
chine color space or perceptual color space. 
[0071] In the foregoing discussion it was assumed 
that the data are received as an uncompressed or de- 
compressed data stream 12-14. If this is not so, and if 
the data are instead acquired as a compressed stream 
11, then the method (or apparatus) begins with a pre- 
liminary step of decompressing that data stream 11 to 
obtain the decompressed data stream 12-14. 

2. TAKING ADVANTAGE OF DOWNSAMPLING 

[0072] In preferred embodiments, the three compo- 
nents of the decompressed image data 1 2-1 4 are scaled 
down to the final or desired file size 1 6-1 8. This may also 
be expressed in terms of the final or desired resolution: 
here the term "resolution" is not used in a spatial or vis- 
ual sense, but rather simply to mean the overall number 
of pixels that will be employed to print, display or other- 
wise present the image in its end use. 
[0073] Only after the data are thus downsampled to 
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the appropriate final si7e Is tlie additional step of com- 
pressing (orrecompressing) performed. Again, this may 
be a JPEG or Tl FF formatting or some other very differ- 
ent procedure. 

[0074] This scaling-down of the image information 5 
12-1 4 to 1 6-1 8 naturally is valuable in reducing required 
storage space as well as data-bus operating time. 
Equally or more important, with respect to generation of 

artifacts a significantly smaller file usually behaves es- 
sentially as a new data set In the following compression 
or recompression stage, 

[0075] This latter effect may be due to a general 
decorrelation between the functional data blocks used 
at this stage and like data blocks used in any earlier for- 
matting stage. For instance, Interactions between 
rounding errors in two such stages, or even beat-like in- 
teractions between the sizes of the blocks, are generally 
destroyed in the downsampling process. 
[0076] In any event, the observed result Is that per- 
ceptible Image defects In the stored or onward-transmit- 
ted data set 1 9 are substantially avoided. To all practical 
Intents and purposes, the artifacts noted in the prior art 
are eliminated and the data set can be used for printing, 
display or other presentation without generating any 
such objectionable elements. 

3. PIECEMEAL PROCESSING 

[0077] Consideration of Fig. 1 reveals that the entire 
uncompressed or decompressed image 12-14 is, im- 
plicitly, held In memory alt at once. Furthermore the en- 
tire data set implicitly is downsampled, too, all at once. 
[0078] Consequently this strategy requires a still larg- 
er memory to hold - also at the same time - the portions 
of the data dynamically in progress at any moment, as 
well as the entire scaled-down data set being devel- 
oped. While such operation is within the scope of certain 
of the appended claims, the present invention also pro- 
vides strategies for avoiding such requirements, to en- 
able use of a very small memory. 
[0079] In accordance with these strategies, the 
processing of an entire image 21 {Fig. 2) is instead done 
in strips 22-25, or more generally in increments of pref- 
erably predefined minimum processing units. For in- 
stance a few rows can be scaled down and then com- 
pressed or recompressed, and finally passed on for stor- 
age or forward transmission. 

[0080] Consider first a case of only modest complex- 
ity, with the first and second units of processing set to 
one-quarter of the input image and one-half of the output 
image, respectively. The first strip 22, which thus may 
be the top quarter of the original image, is downsampled 
isotroplcally (i.e. by the same factor vertically and hori- 
zontally) to form a smaller strip 26 in the sample buffer. 
[0081] The reduction in the Illustrated example is by 
about a factor of two in each dimension. Therefore the 
amount of data 26 in the buffer, now representing the 
original strip 22, is only a quarter the amount of data in 



that original strip 22. 

[0082] Next this treatment of the first strip 26 is iterat- 
ed for the second. More specifically the first reduced 
strip 26 is retained in the buffer as at 27 while a second 
piece 23 of the original image - the second quarter of 
that image - is downsampled and shifted into the sarne 
buffer, where it forms a second small strip 28. The re- 
duction of the second strip 23, 28 is, like the first strip, 
by a factor of two in each dimension. 
[0083] Consequently the two strips 27, 28 of data now 
accumulated in the buffer - representing the downsam- 
pled top half of the image - now equal one-quarter the 
amount of data in the top half 22-23 of the original image 
21 . The accumulated reduced data 27-28 are next com- 
pressed for output or storage. 

[0084] In the Illustrated case, for purposes of clarity 
only, the amount of compression has been chosen to be 
by a factor of unity - which is to say, the data are not 
really shown compressed at all, though they may be 
changed in fpnnat. Accordingly the "compressed" top 
half of the image Is shown as the same size as the down- 
sampled data in the buffer. 

[0085] The reason for this choice of convention - i.e., 
use of an example with 1 :1 "compression" - is to avoid 
misleading the reader This will be explained in the fol- 
lowing paragraphs as a brief digression. 
[0086] Actual size compression in, for example, a 
JPEG compression varies strongly with characteristics 
of the image, as well as a selection process by the hu- 
man operator As will be recalled, this type of compres- 
sion operates by escalating discrimination of finer and 
finer chromatic detail in the image. 
[0087] Therefore an image with little or no fine color 
detail can be compressed greatly without significant per- 
ceptible loss - even if the image is inspected closely by 
an expert. On the other hand, attempting a like degree 
of compression of an image with a great amount of fine 
color-detail variation may severely wash out or blur the 
many small color features into one another. In an ex- 
treme case the process may even create a false, aver- 
aged hue that is not present at all in the original image. 
Analogous luminance error is much less severe, though 
certainly present. 

[0088] With this much variation among images it could 
be confusing to show any particular, artDltrarily selected 
amount of compression. This confusion would be further 
exacerbated by the fact that "quality" decisions selected 
by individual operators also vary strongly. 
[0089] Hence an Image accepted at a particular qual- 
ity level by one operator - or for one purpose - may be 
entirely unacceptable to another operator, or even to the 
same operator but for a different purpose. For example, 
a photographer's batch of forty small "proof prints" sub- 
mitted to a customer might be quite acceptable even if 
data for each image are downsampled and compressed 
to a 5 kbyte file. 

[0090] The purpose is only to enable the customer to 
select which poses are preferred, and in fact the 200 
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kbyte batch can even be transmitted to the custonner by 
e-mail without undue delay at customary slow dial-up 
speeds over conventional analog telephone lines. On 
the other hand, if a single one of those frames is then 
selected for high-quality printing, possibly that frame 
should be presented to the printer as a file of one or 
more megabytes. 

[0091] Lest the 1:1 compression illustrated in Fig. 2 
be itself confusing, please bear in mind that the actual 
numerical compression in a JPEG image, ignoring 
downsampling or upsampling. is commonly from a half 
order of magnitude to two or more orders of magnitude 
(I.e. by a factor of three to a hundred or more) for a rep- 
resentative image and typical consumer usage. 
[0092] Now returning to the discussion of Fig. 2, after 
the first input half-image 22-23 has been downsannpled 
into the buffer and compressed to fomri a first output half- 
image 31 , the procedure Is Iterated for the bottom of the 
same input half-image 24-25. That is, the third and then 
the fourth input quarter- images 24,25 are downsampled 
and layered into the buffer as reduced quarter- images 
32, 35; and this accumulated bottom half-image 32-34 
is then compressed to tonn the final output half-image 
37. 

[0093] During these steps the upper output half-im- 
age 31 is preserved In the output data as 33 and 36. 
Eventually in combination the upper and lower output 
half-images 36, 37 fomri the entire output Image 36-37. 
[0094] If the memory cannot accommodate an entire 
strip, then it is possible to fall back to either: 

(a) an entire single row (or column - depending on 
the direction in which the incoming data are organ- 
ized) - or 

(b) a partial strip, Le^ several rows or columns but 
extending only partway across or down the image. 

[0095] Still further, if it is not feasible to acquire an en- 
tire row or column at once, the system can break up the 
reception and processing into smaller operations - but 
this complicates the algorithm, paying a penalty in 
processing overhead for the use of smaller memory. Re- 
ceived increments need not be a full strip or row, as long 
as what is received provides enough information to 
scale down, and enough information to compress. 
[0096] Conventional JPEG formatting is based upon 
8x8-pixel squares. One relatively extreme approach is 
to receive or compress (or both) each of those squares 
separately, but even that strategy limits the system to 
scaling on the boundaries of those squares, not be- 
tween them. 

[0097] The smaller the increments, the less straight- 
forwardly or generally they can be scaled down or com- 
pressed. For instance, if the system accepts a single row 
as the first unit of processing, that unit cannot be scaled 
vertically, only horizontally. 

[0098] In the case of a data stream that is received in 
a compressed form 1 1 , the piecemeal approach just out- 



lined should be extended upstream to the preliminary 
decompression step as well. The same general ap- 
proach is required, if it is assumed that the decom- 
pressed image cannot fit into the available memory. In 
5 other words, the incoming data stream is first stripwise 
(or otherwise incrementally) decompressed - before the 
piecemeal scaling and recompression mentioned 
above. 

10 4. CONTINGENT PROCESSING 

[0099] Not all images are candidates for compression 
using the method of Fig. 2. For example, assuming that 
an image is to be printed at unit resolution of 12 pixel/ 

IS mm (300 pixel/inch), the desired overall image "resolu- 
tion" (i.e. total number of pixels in one direction) for a 
typical image printout is larger than the original image. 
[0100] Such an image has to be scaled up before 
printing. Table A (Fig. 3) shows the sampling factor 

20 based on 12 pixel/mm final output -for five common print 
sizes in centimeters or inches, and three representative 
original-image sizes in MP (megapixels). As can be 
seen, the sampling factor is greater than unity (it is an 
upsampling) for all but four of the cases represented. 

25 [0101] The Fig. 2 method, however, may yet be fea- 
sible if the operator and the intended use of the printout 
are amenable to a lower unit resolution, such as for ex- 
ample 8 pixel/mm (200 pixel/inch). Table B shows the 
sampling factor for this unit resolution, and for the same 

30 fifteen cases as Table A. 

[0102] Here downsampling is seen to be possible in 
' fifty or sixty percent of practical cases. Accordingly it 
may now be appreciated that no single data-handling 
regimen can be appropriate for all situations, and the 

35 contingent or "smart" data management recited in cer- 
tain of the appended claims becomes particularly valu- 
able. 

[0103] Such adaptive management In essence tests 
the data and the operating circumstances - including the 

40 unit resolution deemed appropriate - to determine 
whether significant scaling-down of the original image 
is in order. If so, then the system performs the down- 
sampling, and possibly also the iterative piecemeal op- 
eration, discussed in the preceding sections; but it not, 

45 then if possible the system branches to some other strat- 
egy. 

5. APPARATUS 

50 [0104] The image-related device can be a printer or 
instead a display, a scanner, a terrain or benthic map- 
ping system, or in essence any system that transfers or 
stores image-like data. Even a digital book, or even a 
common display unit such as a video screen, can be 
55 downsampled for later more-limited display. 

[01 05] In considering any system for application of the 
described embodiments, a helpful basic characteristic 
is that the system will use the subject data for or within 
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itself. Such a system can be programmed or otherwise 
designed to take account of its own limitations. 
[0106] Two examples relating to a digital camera 41 
(Fig. 4) entail transmission of picture data^ either within 
the camera to a small display 42 for presentation to the 
camera operator or entirely out of the camera to a printer 
43 for recording of the image on paper. As to the display, 
the system is completely closed and downsampling is 
always appropriate; however for the printer there are 
various possibilities. 

[0107] Other camera components include a camera 
frame memory 51 - at least part of which is erasable and 
removable, and serves as a cache for all the pictures 
taken with the camera. It will be understood of course 
that the camera includes many optical, electronic, elec- 
trooptical, mechanical and program-executing modules 
that are upstream of the frame memory 51 and are de- 
voted to original acquisition of Image data. All of those 
components, although naturally of great interest and im- 
portance to camera design as such, are outside the 
scope of this document. 

[0108] The camera also includes a processor, which 
for high-volume retail-consumer cameras may advanta- 
geously bo an application-specific integrated circuit 
(ASIC) 52. It performs all of the data movement and se- 
quencing. A somewhat more common variation mod- 
ernly is to perform the Intensive computations in a digital 
signal processor (DSP): which is a much more general- 
purpose device than an ASIC. 

[01 09] Another key part of the camera for present pur- 
poses is the three-part memory complement 61-63 that 
serves the display. In some cases the various memory 
elerpents may be built into the ASIC. 
[01 1 0] Since image data may be stored in the frame 
memory 51 as JPEG- or otherwise-compressed files - 
although this is quite unusual in the present state of the 
art - the ASIC 52 may include a decompressor 53 that 
iteratively operates upon successive strips or segments 
of the data stream 102 from the frame memory. That 
operation may proceed analogously to the more-central 
processing that is described below. 
[0111] In any event, decompressed or originally un- 
compressed data may next pass to the first accumulator 
bank 61 in the display-associated memory introduced 
earlier These data remain In the memory unit 61 until 
enough information-'enough" according to the design 
adopted for the system - has been stored for downsam- 
pling. 

[0112] From there the cached data 104 proceed to a 
color-space conversion stage 54, to express the image 
information in the YCC color space - a part of conven- 
tional JPEG processing which, as mentioned eariier, 
can be omitted in many practical cases. 
[0113] Decompressed and possibly converted data 
1 03 next flow to a scaling-down or downsampling mod- 
ule 55, which selectively passes a reduced quantity of 
data 1 05 back to the memory - but to a different memory 
portion 62, which is devoted to accumulating data for 



compression. When that accumulator 62 holds sufficient 
data for compression, those data 106 flow again to the 
ASIC but particulariy to a compressor section 56 in the 
ASIC. 

5 [0114] This section 56 perfomns whatever type of 
compression or other formatting is appropriate for use 
in the small LCD display of the camera, and then returns 
now-formatted data 107 to the final display-associated 
memory section 63. The data are held there for passage 
to the LCD itself. 

[0115] With the possible exception of the frame mem- 
ory 51, the camera components discussed so far are 
substantially a closed system. Accordingly some liber- 
ties can be taken with the use of file headers and mark- 
ers, relative to more-standardized file fonmatting that is 
needed for data to be passed from one camera, com- 
puter, printer or computer to another. 
[0116] In general in such a closed system, the rela- 
tionships between data quantities flowing through differ- 
ent parts of the system may be established once and for 
all when the system is designed. In particular, both the 
unit resolution and the physical size of the LCD display 
42 (and accordingly the overall total pixel size) are fixed 
at manufacture. 

[0117] After that, in operation of the system it should 
not be necessary to take steps to determine what data 
size relationships are; the design relationships can be 
assumed. There should be no necessity for contingen- 
cies in the processing protocol. 

[0118] Considerably greater care should be taken - 
even though the principles of application are the same 
- with a system that straddles two wholly different pieces 
of equipment. This is the case with the camera 41 when 
operated in conjunction with the printer 43. 
[0119] It is here that the variability of output-data 
quantities, discussed in section 3 above, comes into 
play. The paper 87 may be of various sizes, and the unit 
resolution is also variable. Hence the overall total-pixel 
size can vary widely, and in some systems it is advisable 
to provide contingent branching of the process to ac- 
commodate the variation. 

[0120] In exceptional cases as noted eariier, data in 
the frame memory 51 may be stored precompressed; 
however, in more common configurations the frame 
memory holds uncompressed data - which are prefera- 
bly compressed before passage to the printer. For that 
purpose a compressor stage 57 may be included in the 
camera ASIC 52. 

[0121] Next the data advantageously proceed to an 
infrared transmitter 58 - or to a cable connector if direct 
wiring is to be employed. The !R stage 58 if present may 
be built directly into the ASIC 52 as illustrated or may 
instead be partly or entirely separate. 
[0122] In any event the camera output data 71 flow to 
a receiving unit 64 in the printer 43. The receiver 64 may 
be an infrared subsystem, or a cable connector, or other 
suitable input/output component corresponding to the 
component 58 in the camera. 
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[0123] For some printers, as suggested in the illustra- 
tion, it may be preferable to operate the programmed 
instructions in firmware 72 - a general-purpose proces- 
sor reading instructions from a ROM or PROM - rather 
than in a hardware ASIC 52 or DSP as in the display 
driver within the camera. In addition there may be some 
contribution from software 86 operating in a general- 
purpose computer 85 (or from a program running in a 
raster-image processor not shown). These various op- 
tions are illustrated sheerly by way of example, without 
intending to Indicate in any general way that some are 
more practical for some purposes than others. 
[0124] Another evident difference is that the output 
data 11 6 in the prlnterflow to control modules 77 for op- 
erating the hardcopy marking devices of the printer, 
rather than to a display 42 as in the camera. Apart from 
these differences, the principles of operation as embod- 
ied in the printer are very much as in the camera. 
[0125] Thus the intemnediate blocks and functions at 
73 through 76 in the printer are substantially Identical 
(though In general they will process greater quantities 
of data) to the corresponding blocks and functions 53 
through 56. Similarly the memory modules 81 through 
83 in the printer are functionally identical (though larger) 
to the corresponding memory modules 61 through 63 In 
the camera. 

6. METHOD 

[0126] In view of all the foregoing, operation of the 
preferred method will be largely self explanatory from 
the flow chart of Fig. 5 - which is intended to cover op- 
eration of a relatively general system such as the printer 
control of elements 73 through 78 discussed above. It 
maybe seen, however, that the overall scheme includes 
branching at 120 and 132, depending upon the data re- 
lationships. 

[01 27] The result is that some method 1 26 (e.g. con- 
ventional storage of the entire image file) to prepare for 
use 1 27 of the whole image is employed where appro- 
priate; and the novel steps 121 through 144 of the 
present invention are used otherwise. Even In the latter 
case, as suggested eariier a more-conventional bypass 
128 is provided around the downsampling step 133, for 
use when the incoming data do not represent a greater 
overall dimension than the output image as it is to be 
used in the camera. 

[01 28] The drawback of following the bypass path 1 28 
is that image artifacts are often generated by serial com- 
pression and decompression without the intermediate 
down-scaling. The benefits of the described embodi- 
ments, however, are enjoyed whenever the favorable 
size relationships are present. 

[0129] In any event, the method includes iterations 
135, 144 of the core operations 124, 128 (when appli- 
cable), 131 through 134, and 141 through 143. These 
iterations with small data quantities are exploited to sys- 
tematically layer the downsampled (when applicable) 



and compressed image data into small memories. 
[0130] TIFF or JPEG formatting, or other JPEG-like 
variants that make use of the direct cosine transform 
(DOT) or related Fourier analysis, can be used even 
5 though the entire image is never manipulated at once. 
The overall result is significant economy without image 
degradation. 

[01 31 ] The preferred embodiment is very versatile. As 
noted earlier, even the conversion from RGB to YOG can 

10 be omitted and the benefits of the invention enjoyed 
while transferring data in RGB. Similarly transmission 
and processing can be performed in virtually any color 
space including other perceptual spaces, other ma- 
chine-language spaces such as subtractive CMY or 

15 CMYK, or hybrid HPG (hue plus gray) space. 

[01 32] The above disclosure is intended as merely ex- 
emplary, and not to limit the scope of the claims. 
[0133] The disclosures in United States patent appli- 
cation no. 09/474,596, from which this application 

20 claims priority, and in the abstract accompanying this 
application are incorporated herein by reference. 



Claims 

25 

1. A method for receiving input-image data in an im- 
age-related device having a memory whose use is 
to be limited; said method comprising the steps of: 

30 receiving (122) a data stream containing the 

data and substantially corresponding to a se- 
ries of successive strips of an image; 
establishing (121) minimum units of processing 
that are related to a fonriat of the data stream, 

35 to an output-image fomriat, and to the below- 

recited steps; and 

during the receiving step, after receiving data 
for at least a first of said minimum units of 
processing: 

40 

downsampling (133), in at least one direc- 
tion, the dataforthefirst received minimum 
unit of processing, 

then accumulating (1 34) the downsampled 
45 cJata for at least a second of said minimum 

units of processing, and 
then compressing (14) the accumulated 
downsampled data. 

50 2. The method of claim 1 , wherein: 

the first unit of processing is at least a partial 
strip of the image, said at least partial strip contain- 
ing enough information to enable said downsam- 
pling. 

55 

3. The method of claim 2, wherein: 

the first unit of processing is a full strip of the 
image, said full strip comprising at least one full pix- 
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el column or row. 

4. The method of claim 1 , wherein: 

the second unit of processing is at least a par- 
tial strip of the image as it islo be presented by the 
image-related device, said at least partial strip con- 
taining enough information to enable said com- 
pressing, 

5. The method of claim 1 , wherein: 

the second unit of processing is a full strip of 
the Image as It Is to be presented by the image-re- 
lated device, said full strip comprising at least one 
full pixel column or row. 

6. The method of claim 1 , wherein: 

the downsampling step comprises downsam- 
pling the data to a pixel dimension of the received 
strip as it is to be used in the image-related device. 

7. The method of claim 1 , wherein the compressing 
step Is selected from the group comprising: 

JPEG compression; and 

data formatting which is of a type associated 
with TIFF files. 

8. The method of claim 1 , wherein the accumulating 
step comprises accumulating a quantity of the 
downsampled data selected from the group consist- 
ing of: 



determining (1 20) whether the data stream rep- 
resents an overall pixel dimension greaterthan 
desired in the image as it is to be used in the 
image-related device; and 
5 if not, then omitting the downsampling step. 

10. An image-related device (41 , 43) having a memory 
(63, 81 -83) whose use is to be limited, and compris- 
ing: 

10 

a data receiver (52, 64) for receiving a data 
stream containing image data and correspond- 
ing to a series of successive strips of an Image; 
at least parts of a programnied processor (52, 
15 72) and memory (61 , 62) for: 

downsampling (55, 75) the received data 
for at least part of a strip In the series as 
received, 

20 accumulating (62, 82) the downsampled 

data for at least part of one received strip, 
compressing (56, 76) the accumulated da- 
ta for at least part of an image strip to be 
presented, and 

25 storing (1 07, 11 5) the compressed data for 

presentation; and 

elements (42, 77) for presenting the image 
based upon the stored compressed data (63, 
30 83). 



enough of said downsampled data to enable 
JPEG compression of a strip of the image as it 
is to be used in the image-related device; 55 
enough of said downsampled data to enable 
TIFF fomiatting of a portion of the Image as it 
is to be used In the Image-related device; 
enough of said downsampled data to represent 
at least one discrete-cosine-transformable 40 
block of the image as it is to be used in the im- 
age-related device, for application of a discrete 
cosine transform thereto; 
at least enough of said downsampled data to 
represent at least one eight-by-eight-pixel ^5 
block of the image as it is to be used in the im- 
age-related device, for application of a discrete 
cosine transform thereto; and 
at least enough of said downsampled data to 
represent a strip of eight-by-eight-pixel blocks 50 
of the image as it is to be used in the image- 
related device, for application of a discrete co- 
sine transform thereto. 



9. The method of claim 1 , further comprising the steps 55 
of: 



after or in association with the receiving step, 



11 

BNSDOCID: <EP 1 1 19177A2_I_> 



EP 1 119 177 A2 



ORIGINAL JPEG 
STREAM 



UNCOMPRESSED SCALED DOWN 



IMAGE 




Cr 



14 



IMAGE 



16 



Y 



Y 



17 



18 



REDUCED JPEG 

STREAM 



7 



19 



FIG. 1 



FIG. J 



TABLE A 
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3^^2x5 


4x6 
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8x10 


1.0 MP 


0.85 


1.30 


1.56 
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1.3 MP 
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1.41 


1.64 


2.34 


2.0 MP 


0.61 


0.94 


1.13 


1.31 


1.88 



TABLE B 



5.7x8.3 



8.9x12.7 10.2x15.2 12.7x17.8 20.3x25.4 CM 

INCHES 



ORIGINAL IMAGE 


2^/4x3^/4 


3^^2x5 


4x6 


5x7 


8x10 


1.0 MP 


0.56 


0.87 


1.04 


1.22 


1.85 


1.3 MP 


0.51 


0.78 


0.93 


1.09 


1.56 


2.0 MP 


0.41 


0.63 


0.75 


0.87 


1.25 



12 

BNSDOCiD: <EP 1 1 19177A2J_> 



EP 1 119177 A2 



ORIGINAL IWAGE 



r 



2U 










































SCALING BUFFER 

m 



^22 26 



COMPRESSED 
IMAGE 





13 

BNSDCXDID: tEP 1119177A2J_> 



EP 1 119 177 A2 



comero frame memory 



51 



10U 



102- 



52 



in-camera programmed 
processor (ASIC) 



5j processor ^^Abiu; 

piecemeol iterative decompressor [ ^^ 



54-^ streomwise YCC converter downsomple) 



55^ 



57 



downsompler 
to given pixel dimension 



frome-doto compressor 



Icompressort 

56 107- 
58 



IR tronsmitter 




73 



103 



41 

^ 

digital camera 



61 



incoming-dato occumulotor 



104 
105 




downsampled-dato accumulator 
(holds enough data for compression) 



106 



comero display memory] 

7 

63 



42 



62 



in-camero display 
(LCD video pixels) 



infrared link 
(compressed doto) 



71 



43 



jlR receiver! /" 



incremental printer 



doto stream (corresponding to image strips) 
JPEG - TIFF ~ RLE ^ other 



72 



firm v^are in PR0M| 



piecemeal iterative 
decompressor 



/// 



streomwise YCC converter 




112 



downsompler 1; 
to given pixel dimension 

~T 76 114 




hardcopy marking elements 
at some given pixel dimension 



FIG. 4 



printer memory (use to be limited) 
c-81 



incoming-data accumulator 
(holds enough data for downsomple) 



downsampled-doto accumulator (holds 
enough data for JPEG compression 
of output-image strip or discrete 
cosine Xform of 8x8-pixel (or other) 
output-imoge block, or strip of blocks 



!32 



compressed data for presentation 



116 



paper 



87 



.111 9177 A2J_> 



14 



EP1 119 177 A2 



120 



does file fit in memory? | jf ^^t. then. 



121- 



\ 



122 



2L 



establish minimum processing units (MPU) 
each preferably a smoll frpction of overall imoge-dota set 



. t 

receive data stream 



125^ 



123- 
124 



decompress received data if necessary 



receive type-1 MPU of data 
at least 1 portiol (most preferably full) strip of input image, 
preferably including at least 1 full pel col/row 



132 

\ 



131 



144 



transform to YCC if necessary/desired 

I 



determine whether the data represent an overall dimension 
greater than the output image as it is to be used in the device 



if so, then: 



if not, then: 



downsample MPU 

to output pixel dimension of received strip; preferably in both 
directions but possibly just horizontol or vertical (e.g. Irow/column) 



133 



134 



I 



/I28 



135. 



type-2 MPU accumulated? 
at least partiol (most pref'ly full) strip of output image — enough 
to enable formatting (see below) of portion of output file, e.g. 
ot leost 1 DCT'oble output— image block, preferably strip of such blocks 



if so. then: 



compress 

compress TIFF, JPEG or other formatting of, e.g., at least 1 
DCT'able block of output image, preferobly strip of such blocks 



142^ 
143^ 



I 



141 



if not, 

then 

iterate 



store for use in device 



144- 



whole image stored? 



if not. then iterote 



store 
entire 

imoge 



126-^ 



FIG, 5 



127-. 



if so, then: 



use whole stored image 



11 19177 A2J_> 



15 



THIS PAGE BLANK (uspto) 



illillllllllilllllilliilllllllliillllllllllllllli 

(11) EP 1 119 177 A3 

(12) EUROPEAN PATENT APPLICATION 

(88) Dateof publication A3: (51) mt CI 7: H04N 1/393, H04N 1/41 

08.05.2002 Bulletin 2002/1 9 

(43) Date of publication A2: 

25.07.2001 Bulletin 2001/30 

(21) Application number: 00310644.0 



(22) -Date of filing: 30.11.2000 



(84) Designated Contracting States: 


• 


Bayerle, Dean 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 




Poway, CA 92064 (US) 


MC NL PT SE TR 


• 


Niemann, Mark 


Designated Extension States: 




San Diego, CA 92116 (US) 


AL LT LV MK RO SI 


• 


Chen, lue-Shuenn 






San Diego, CA 92127 (US) 


(30) Priority: 29.12.1999 US 474596 








(74) 


Representative: Jehan, Robert et al 


(71 ) Applicant: Hewlett-Packard Company, 




Williams, Powell & Associates, 


A Delaware Corporation 




4 St Paul's Churchyard 


Palo Alto, CA 94304 (US) 




London EC4M SAY (GB) 


(72) Inventors: 






• Epstein, Yoav 






San Diego, CA 92123 (US) 







(54) Method and system for receiving input-Image data 




Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



CO 
< 

CD 



Q. 
LLi 



(57) An image-related device (e.g. printer 43 or dis- 
play 42), having a memory (63, 81-83) whose use is to 
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from a camera [41]). The data represent a series of im- 
age strips (21, 22-25). Minimum processing units 
(MRUs) are set up, related to data and output-image for- 
mats and to method. After data acquisition for a first 
MRU type, those data are scaled down (133) in at least 
one direction, the scaled-down data accumulated (134) 
for a second MRU type; and the accumulation com- 
pressed/formatted (141). By iteration (135, 144) the 
whole image is reformatted without injecting artifacts. 
Each MPU type is best a small fraction of the image; the 
character of each MPU is subject to function. Thus each 
MPU may be a partial input-image strip, with enough da- 
ta for downsampling or compression respectively; or a 
full input-image strip with at least a full pixel column or 
row. Preferably downsampling is to a pixel dimension of 
the received MPU as it is to be used, Le. an output strip. 
Formatting is best JPEG or TIFF or the like; analogous 
analysis can be substituted using e.g. a discrete cosine 
transform or other analysis of suitable pixel blocks for 
discrimination of fine color detail. If incoming data are 
compressed, or not in YCC, decompression (123) or 
conversion (131) can be done before downsampling 
(133). Input/output data sizes can be tested (132) to 



evaluate using another method (128, 126) for the novel 
iterative one. Control is by ASIC (52), firmware (72) or 
a printer/display driver (86). 
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